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Quality,  Neaaureaent ,  and  Air  Force  Haintenance  Data  Collection: 


What  ia  Wrong  With  Proceaa? 


I .  Introduction 

Everywhere  you  turn,  you  see  the  word — QUALITY.  The  United  States  is 
engulfed  in  a  condtaent  to  quality,  and  the  aoveaent  has  spilled  over  into 
the  governaent  sector,  including  the  Air  Force.  Everyone  it  seeas,  wants  to 
"get  a  little  quality." 


But  quality  is  not  new  to  the  Air  Force.  In  the  1970*8,  General  Wilbur 
L.  Creech,  then  coaaander  of  Tactical  Air  Coaaand  (TAC),  espoused  aany  of  the 
"new"  tenets  being  bantered  about  today  through  "the  five  P's:  People, 
Purpose,  Pride,  Professionalisa,  and  Product"  (2:-).  One  key  eleaent  of 
General  Creech's  philosophy  was  a  greatly  enhanced  eaphasls  on  aeasureaent. 


TAC's  aircraft  aaintenance  coaaunity  was  a  priae  benefactor  of  General 
Creech's  revolutionary  way  of  leading.  Because  of  his  efforts,  TAC 
aaintalners  received  new  tools,  new  facilities,  and  aost  laportantly,  a  new 
level  of  respect.  Araed  with  this  expanded  arsenal  of  assets,  they  were 
eapowered  by  TAC's  senior  leadership  with  significantly  greater  levels  of  ” 

w 

authority  and  responsibility.  The  results  of  this  eapoweraent  contributed 
significantly  to  the  coaaand  achieving  record  aircraft  alssion  capable  rates. 
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resulting  in  unaetched  levels  of  coabst  cspsbillty,  the  coasend's  priasry 
product . 

A  key  eleaent  of  the  asintslners*  success  was  the  ability  to  aore 
accurately  aeasure  production  and  perforaance.  For  the  first  tiae, 
technicians  were  receiving  aeanlngful  feedback  on  a  variety  of  aeasures 
encoapasslng  the  entire  aircraft  repair  process.  As  a  result,  they  developed 
a  aore  coaprehenslve  picture  of  idiat  they  were  doing  wrong,  and  Just  as 
iaportant,  what  they  were  doing  right.  This  aeasureaent  process  was 
accoapllsh  through  a  series  of  data  collection  systeas  coaaonly  referred  to  as 
the  Haintenance  Data  Collection  (MDC)  systea.  Today,  the  Air  Force  continues 
to  rely  on  the  MDC  process  as  its  priaary  source  for  aaintenance  aeasureaent. 
Unfortunately,  confidence  in  MDC  at  all  levels  within  the  Air  Force  is 
extreaely  low.  So,  tdiat  is  wrong  with  the  process? 

This  paper  will  explore  that  question  by  first  analyzing  the  generic 
structure  of  a  process,  then  exploring  the  role  of  aeasureaent  in  process 
iaproveaent.  With  this  foundation,  the  paper  will  then  aore  broadly  describe 
the  MDC  systea,  analyzing  the  process,  with  the  goal  of  Identifying  the 
probleas  affecting  its  utility.  Finally,  froa  this  analysis,  conclusions  will 
be  drawn  on  how  to  laprove  the  process. 
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II.  VAiat  !•  a  Proceaa? 


A  precursor  to  isproving  a  ayatea  la  understanding  the  concept  of  a 
process.  According  to  Juran,  a  process  Is  "a  systesatlc  aerlea  of  actlona 
directed  to  the  achleveaent  of  a  goal*’  (9:123).  Coopers  and  Lybrand  take  a 
different  tangent,  deacrlblng  a  process  as  "the  basic  building  block"  (1:46) 
of  any  systes.  These  ttio  definitions,  when  coablned,  suggest  a  process  to  be 
a  series  of  Interrelated  events  that  idien  accoapllshed  sequentially,  achieve  a 
predetermined  goal. 

Why  Is  understanding  the  concept  of  a  process  so  Important?  Scboltes  In 
The  Team  Handbook,  suggests,  "whole  new  Insights  open  up  when  you  begin  to 
see  tasks  as  related  series  of  events"  (11:2-2).  By  taking  the  complex  and 
breaking  it  down  into  Individual  parts,  it  Is  easier  to  understand.  Just  as 
Important,  It  Is  easier  to  solve  multi-faceted  problems  by  analyzing  one 
process  at  a  time. 

What  then  are  the  elements  of  a  process?  According  to  Coopers  and 
Lybrand,  there  are  three  elements:  Inputs,  a  transformation,  and  outputs 
(1:46).  Scboltes,  on  the  other  hand,  does  not  talk  of  Inputs  and  outputs. 
Instead,  he  refers  to  customers  and  suppliers  (11:2-4).  Plctorially,  these 
two  definitions  idien  combined  would  be  represented  as  presented  in  Figure  1 
(9:87). 
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Figure  1 

This  BOdel  serves  ss  the  basis  of  analysis  for  the  reaainder  of  the 
paper.  A  further  review  of  each  cosponent  helps  clarify  the  interrelationship 
of  the  individual  eleaents. 

Input .  An  input  is  the  raw  naterlal  for  the  process  (1:46).  It  can  take  the 
fora  of  soaethlng  tangible,  such  as  iron  ore  to  be  converted  into  sheet  aetal, 
or  sheet  aetal  to  be  converted  into  an  autoaobile  fender.  Or  it  can  be 
soaethlng  intangible  such  as  an  idea  or  inforaatlon.  In  either  case,  the 
input  is  sourced  froa  outside  the  process  (1:46). 

Supplier.  The  supplier  provides  the  raw  aaterial,  or  input,  for  the  pxocess 
(9:86).  The  supplier  has  the  responsibility  to  clearly  understand  the 
specifications  of  the  input,  and  to  provide  an  input  that  aeets  those 
specifications.  However,  it  is  the  responsibility  of  both  the  supplier  and 

m 

the  process  owner  to  insure  the  specifications  are  clearly  articulated  to  the 
supplier. 
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L.  The  treneforaetlon  converts  the  Input  provided  by  the 


supplier  to  s  vslue-sdded  product  or  service  (1:47).  The  trsnsforastlon 
Includes  ell  the  tssks  necesssry  to  produce  the  product  or  service. 


Output .  The  output  Is  the  product  or  service  genereted  by  the  trsnsfomstlon. 
Key  to  the  concept  of  output  Is  the  notion  of  “vslue-sdded."  As  trss 
sentloned  shove,  If  the  trsnsfomstlon  ss  designed  sdds  no  vslue  to  the  Input, 
the  sctlons  tsken  do  not  cosprlse  s  successful  process  (1:47). 


Custoser .  The  custoser  Is  the  benefsctor  of  the  output  genersted  by  the 
trsnsforastlon  (1:47).  The  whole  purpose  of  the  process  Is  to  produce  s 
product  for  the  custoser.  If  there  were  no  customer,  there  would  be  no  need 


for  the  process. 


The  key  point  Is  thst  any  systea  can  be  broken  down  Into  a  process  or 
series  of  Interconnected  processes.  Understanding  processes  alone,  however, 
will  not  Insure  that  systeas  are  running  smoothly.  Knowing  how  well  the 
systea  Is  running  Is  just  as  Important.  This  Is  the  role  of  measuring  the 


process . 


III.  Process  Measureaent 


A  critical  eleaent  of  process  laproveaent  Is  process  aeasureaent. 
Without  aeasureaent.  It  Is  laposslhle  to  deteralne  bow  well  a  process  is 
working,  or  how  effectively  an  output  aeets  the  custoaer's  expectations. 
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Purtlier,  It  is  lapossible  to  throve  a  process  Mlthout  first  aessuring  its 


present  perforaance.  iiccording  to  Walton  in  the  DcKtat  IhnMMBnt  Method. 
"Critical  is  the  need  to  base  decisions  as  such  as  possible  on  accurate  and 
tiaely  data,  not  on  Mishes  or  hunches  or  'experience' "  (14:96) . 

Measureaent  can  be  done  on  the  input,  but  is  aost  often  accoaplished  on 
the  output  or  the  process  itself.  Output  data  is  priaarily  results  oriented 
(1:61).  It  gives  the  process  owner  feedback  on  how  closely  actual  products 
aatcfa  the  specifications  of  desired  products.  Process  aanageaent,  on  the 
other  hand,  is  control  oriented  (1:62).  Is  the  systea  in  or  out  of  control? 
If  there  is  a  discrepancy  between  the  desired  and  actual  output,  process  data 
can  help  identify  the  cause  of  the  discrepancy.  Or,  process  data  can  be  used 
to  Identify  ways  to  aake  the  process  aore  efficient,  even  ^en  output 
specifications  are  being  aet. 

The  decision  of  what  to  aeasure  depends  priaarily  on  deciding  for  what 
purpose  the  data  will  be  used  (11:5-38).  If  feedback  is  required  on  product 
quality,  or  the  ability  of  a  product  to  aeet  specifications,  results  data  are 
required.  If,  however,  additional  efficiencies  in  the  process  are  being 

is 

sought,  process  data  are  needed.  Regardless  of  what  type  pse  needed,  process 
owners  should  deteraine  data  collection  requireaents. 


•  •  •  • 
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within  the  Air  Force  neintenence  conunity,  there  is  a  reliance  on  both 


results  and  process  data.  One  exaaple  of  process  data  is  nalntenance  nanagers 
■onltor  four  hour  and  eight  hour  fix  rates  to  deternine  how  efficiently 
■aintenance  technicians  are  repairing  aircraft.  A  najorlty  of  the  data 

is 

collected  however,  ave  results  data.  This  Includes  but  is  not  United  to^ 
alssion  capable  rates,  break  rates,  configuration  data,  cannibalization  rates, 
and  down  tine  for  both  parts  and  nalntenance.  Once  collected,  these  data  are 
analyzed  at  all  levels,  fron  individual  aircraft  at  base  level,  to  entire 
fleets  of  aircraft  by  Air  Force  Material  Connand  (AFMC)  and  weapon  systen 
contractors . 

Having  deternlned  the  data  collection  goal  and  lAat  data  are  to  be 
collected,  the  next  decision  is,  "How  to  collect  the  data?"  Within  the  Air 
Force  the  answer  to  this  question  is  the  Maintenance  Data  Collection  systen. 

IV.  The  Maintenance  Data  Collection  Systen 

To  Increase  conbat  capability  and  operational  suitability,  the  Air  Force 
is  concentrating  its  efforts  on  naklng  weapon  systens  sore  reliable  and  nore 
nalntalnable  (4:1).  This  concept  is  collectively  nanaged  under  acquisition 
guidance  known  as  Reliability  and  Maintainability  (R&M)  Policy  (4:1).  The 
purpose  of  the  Maintenance  Data  Collection  (MDC)  process  is  to  collect,  store. 
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and  retrieve  bane  level,  depot  level,  and  contractor  type  nalntenance  data  In 
support  of  Inplenenting  H&M  policy  (6:1-1). 

The  MDC  ayaten  aervea  aa  the  source  of  both  process  and  results  data  in 
support  of  R&M  efforts.  These  data  are  used  by  AFHC  and  by  civilian 
contractors  to  inprove  Air  Force  weapon  systems.  In  addition,  MDC  data  are 
used  at  base  level  to  provide  "infornatlon  feedback  to  base  managers  and 
supervisors  for  controlling  the  nalntenance  operation'*  (6:1-2).  This 
Includes  providing  data  while  base  level  personnel  are  deployed.  Further, 
major  operational  commands  use  MDC  data  to  aid  in  weapon  system  management 
decisions.  Finally,  Headquarters  Air  Force  uses  MDC  data  to  determine  the 
cost  of  base  level  nalntenance  operations. 

The  MDC  process  relies  on  automation  to  collect  the  data.  Separate 
systems  have  been  developed  for  collection  at  base  level  and  to  consolidate 
the  data  at  AFNC.  Eventually,  depot  maintenance  data  nay  be  consolidated  with 
the  base  level  data  at  AFMC,  but  Interfaces  to  make  this  a  reality  do  not 
presently  exist.  Therefore,  this  paper  will  consider  only  data  collected  at 
base  level  as  the  source  for  nalntenance  data. 

Although  a  number  of  base  level  collection  systems  exist,  the  most  widely 
used  is  the  Core  Automated  Maintenance  System  (CAMS).  Aircraft  nalntalners 
throughout  the  Air  Force  use  CAMS  to  collect  data  on  aircraft  assigned  to 


their  respective  bases.  Once  collected,  this  inforaation  is  electronically 
trsnssitted  to  AFMC  and  consolidated  with  data  fron  all  other  bases  in  the 
Seliability  and  Nalntainability  Infornatlon  Syaten  (REMIS). 

Like  all  processes,  the  MDC  syaten  is  nade  up  of  suppliers,  inputs,  input 
transforaatlon,  outputs,  and  custoaera.  Using  the  process  nodel  previously 
developed,  the  MDC  process  can  be  pictorlally  represented  as  presented  in 
Figure  2. 


(Custoaers) 

Figure  2 

As  has  been  previously  aentloned,  there  is  a  very  low  level  of  confidence  in 
the  MDC  system  within  the  Air  Force.  Using  this  representation  as  a  basis, 
the  process  can  be  broken  down  and  analyzed  to  identify  what  problens  exist 


within  the  MDC  systen. 


V.  Analysis  of  the  HOC  Process 


According  to  a  1990  Air  Force  audit,  the  MDC  systes  is  "inadequate  to 
ensure  the  accuracy,  tiaelineas,  and  integrity  of  the  data"  (5:3).  A  recent 
study  found  that  aany  contractors,  a  prise  MDC  process  custoser,  use  MDC  only 
as  a  second  source  of  data  if  at  all,  because  of  concerns  over  its  accuracy 
(13:9).  What  is  wrong  with  the  process?  An  analysis  of  probless  in  each 
process  eleaent  will  help  provide  soae  clues. 

SuDOliers.  The  primary  suppliers  of  MDC  data  are  base  level  maintenance 
technicians.  As  expected,  a  maintenance  technician's  primary  responsibility 
is  to  launch,  recover,  and  repair  aircraft.  As  part  of  these 
responsibilities,  technicians  are  required  to  record  key  information,  and 
input  it  into  the  MDC  system.  This  information  encompasses  flight  data, 
aircraft  system  discrepancies,  and  maintenance  repair  actions.  Most 
maintenance  however,  takes  place  on  the  flightline  or  in  hangars,  neither  of 
tdtich  is  readily  accessible  to  CAMS  terminals.  As  a  result,  inputting  data 
into  the  system  becomes  "an  additional  chore,”  and  accomplished  when 
convenient.  Further,  since  the  data  are  normally  not  input  immediately  upon 
completion  of  a  task,  the  technician  usually  manually  documents  the 
information,  and  then  transcribes  the  data  into  CAMS  at  a  later  time. 
Periodically,  the  manual  documentation  is  lost  and  the  Information  is  not 


10 


recorded.  In  other  Instances  (estlasted  to  represent  25  percent  of  the 
intentionally  generated  errors  in  CAMS),  the  technician  siaply  elects  not  to 
record  the  data  (7:61).  In  both  cases,  the  results  are  holes  in  the  data  base 
and  seasures  generated  with  incoaplete  information. 


What  would  cause  technicians  not  to  record  data?  The  answer  is  that 
technicians  perceive  little  personal  benefit  from  the  MDC  system.  A  recent 
study  shows  only  25  percent  of  fllghtllne  maintenance  technicians  felt  the  MDC 
system  aided  in  the  performance  of  their  duties  (8:C-4).  A  review  of  the  MDC 
process  model  explains  why.  Maintenance  technicians,  by  design,  are  not  a 
customer  of  the  process.  Further,  they  receive  no  compensation  for  supplying 


data  as  would  a  supplier  in  the  business  community.  Finally,  because  the 


« 


primary  use  of  the  data  is  for  H&M  improvements  which  take  many  years  to 
complete,  technicians  can  make  no  correlation  between  inputting  the  data  and 
seeing  improved  maintainability  in  their  aircraft.  As  a  result,  the  data 
suppliers  have  little  motivation  to  insure  the  process  is  effective. 


Innut .  The  input  for  the  MDC  process  is  raw  maintenance  data  collected  by 
maintenance  technicians.  Air  Force  regulations  and  technical  orders  clearly 
spell  out  what  data  should  be  collected.  Many  of  the  data  elements  however, 
are  general  in  nature,  and  require  Interpretation  or  a  "best  guess"  by  the 
technician.  For  example,  one  element  collected  defines  the  nature  of  how  an 
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aircraft  failed.  For  the  F-16,  there  are  305  choices,  aaong  thea  "worn," 


"failed,"  and  "broken"  (13:12).  This  level  of  choice  relies  on  a 
technician  to  sake  a  subjective  decision  about  lapreclse  teras,  aaklng 
analysis  of  the  results  alaost  aeanlngless. 

In  addition,  MDC  collection  requireaents  have  not  been  updated  since  they 
were  established  in  1958  (10:24).  As  a  result,  data  eleaents  that  could 
provide  aore  accurate  failure  inforaation  have  not  been  incorporated.  For 
exaaple,  the  Maintenance  Integrated  Data  Access  Systea  (MIDAS)  provides  a  aore 
coherent  tie  between  systea  failure  aodes  and  repair  actions  then  does  the 
present  MDC  data  eleaents  (10:21-22).  As  a  result,  if  MIDAS  were  incorporated 
into  MDC,  auch  aore  coherent  conclusions  could  be  drawn  froa  MDC,  aaklng  the 
process  output  data  aore  aeanlngful  to  systea  custoaers.  However,  due  to  the 
estlaated  cost  of  its  inclusion,  the  Air  Force  has  taken  no  action  to 
incorporate  the  MIDAS  data  eleaents  into  MDC. 

Trans foraation  Process.  Understanding  how  to  properly  input  data  into  the 
MDC  systea  is  essential  for  an  effective  transforaatlon  process. 

Unfortunately,  nearly  every  study  done  identifies  a  lack  of  training  on  the 
MDC  systea  as  the  prlaary  problea  with  the  process.  In  one  survey,  41  percent 
of  those  technicians  Interviewed  Identified  Insufficient  training  as  the 
prlaary  problea  with  MDC,  nearly  twice  as  aany  as  those  selecting  the  second 
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choice  (7:61).  Vflthout  edequate  tralnins,  technicians  are  frustrated  in 
trying  to  use  the  systea,  and  ultiaately  end  up  inaccurately  entering 
inforaation  or  not  entering  it  at  all. 

The  second  aost  often  identified  problea  viith  the  MDC  systea  is  a  lack  of 
''user  friendliness"  (7:61).  This  is  due  in  part  to  a  lack  of  training  on 
how  to  use  the  systea.  In  addition,  technicians  are  often  required  to  use 
aultiple  screens  to  enter  inforaation  and  have  no  "help"  screens  avallahle 
to  guide  thea.  Further,  those  aids  that  are  available  (Air  Force  regulations) 
are  often  written  with  a  highly  trained  coaputer  user  in  alnd,  and  provide  no 
additional  help  for  the  average  aircraft  aalntenance  technician. 

Finally,  the  base  level  coaputer  that  houses  the  MDC  systea  also  houses  a 
variety  of  other  base  level  coaputer  systeas.  High  voluae  use  by  these  other 
systeas  can  have  a  significant  lapact  on  the  speed  with  tdilch  the  base  level 
coaputer  accepts  MDC  Inputs.  As  a  result,  technicians  often  becoae  frustrated 
with  the  length  of  tlae  required  to  input  the  data,  and  elect  to  not  aake  the 
inputs  at  all.  Further,  the  base  level  coaputer  is  periodically  brought 
''off-line"  (aade  unavailable  to  coaputer  systea  users  froa  all  specialties) 
during  peak  periods  of  use,  asking  the  loss  of  data  collected  during  those 


periods  aore  likely. 


Output .  The  prlaary  probleu  ui '  i  the  output  process  Is  that  the  narrative 


portion  of  aircraft  failure  data  is  "lost"  during  the  transforaatlon  phase. 
Presently,  CANS  collects  the  narrative  inforaation  and  aakes  the  Information 
available  at  base  level.  At  present  however,  REMIS  Is  unable  to  collect  this 
data  and  therefore  unable  to  provide  it  to  the  custoaers.  How  significant  Is 
this  systea  shortfall?  An  Air  Force  Logistics  Management  study  suggested  that 
narrative  data  was  the  primary  Information  R&M  engineers  relied  on  to  make 
assessments  (13:15). 

Lack  of  narrative  Information  Is  further  exacerbated  by  the  general 
nature  of  the  data  collected  as  previously  described.  Returning  to  the  F-16 
example,  R&M  engineers  are  limited  In  the  depth  of  their  analysis  when  the 
data  they  are  assessing  is  couched  in  terms  such  as  ’’worn"  and  "broken.** 

The  utility  of  the  data  Is  reduced  even  further  when  considering  these 
subjective  terns  were  selected  by  maintenance  technicians  who  may  have  become 
disenchanted  with  the  process. 

Finally,  the  output  is  not  tine  sensitive.  On  average,  customers  must 
wait  45  to  60  days  after  the  data  Is  collected  before  it  is  available  for 
assessment  due  to  the  time  required  by  AFNC  to  process  the  data  (10:20). 
Although  this  nay  be  acceptable  to  R&M  engineers  making  trend  assessments,  it 


14 


has  negative  laplicatlona  for  managers  at  major  commands  tr3^ng  to  identify 


incremental  changes  in  operational  readiness. 


Customers .  As  previously  discussed,  there  are  significant  concerns  about  the 
validity  of  MDC  data.  Cumulatively,  these  shortfalls  lead  many  MDC  customers 
to  question  the  accuracy,  and  therefore  the  utility,  of  the  output.  In  other 
words,  the  process  output  is  failing  to  meet  the  requirements  of  the 


customers . 


In  addition,  as  presently  designed,  the  MDC  system  fails  to  provide  any 
data  to  deployed  senior  leaders  or  their  staffs.  Rather,  data  collected 
idiile^ deployed  is  funneled  back  to  home  station  and  consolidated  with  data 
from  aircraft  that  are  not  deployed.  For  example,  during  Desert  Shield/Storm, 
the  CEHTAF  logistics  staff  had  to  rely  on  phone  calls  to  each  of  the  operating 
locations  for  status  information  on  each  deployed  organization's  respective 
aircraft.  Meanwhile,  home  station  logistics  staffs  had  a  complete  picture  of 
status  information  for  their  respective  deployed  aircraft.  This  failure  to 
make  MDC  data  available  to  deployed  leaders  is  a  major  flaw  with  the  process, 
as  it  ignores  the  requirements  of  one  of  the  system's  key  customers. 


Although  this  analysis  has  Identified  numerous  problems  with  the  MDC 
system,  the  combination  of  CAMS  and  REMIS  is  a  dramatic  Improvement  over  the 
manual  process  that  existed  prior  to  1985.  Further,  there  are  many  actions 


•  • 


ongoins  to  Mke  oddltlonal  iaprovoaent*  to  the  ttm  eysteae.  There  etlll 
reaalne  however,  nuaeroue  eyetea  shortfelle  requiring  attention.  The 
reaalnder  of  the  paper  will  be  dedicated  to  developing  a  road  nap  for 
acconpllabing  those  laproveaenta . 

VI.  Soad  Map  For  laproving  NDC 

The  paper  has  thus  far  Introduced  the  role  of  the  MDC  systen,  built  a 
nodel  for  analyzing  MDC,  and  using  that  aodel,  identified  problens  that 
presently  exist  within  the  MDC  process.  The  reaalnder  of  the  paper  will 
concentrate  on  suggesting  how  to  inprove  the  MDC  systen.  Before  building  the 
road  nap  however,  it  is  first  necessary  to  define  the  future  environnent  that 
the  MDC  process  will  operate  in. 

The  Air  Force,  as  with  all  of  the  ailitary  services,  is  presently 
undergoing  a  dranatlc  downsizing.  This  is  due  in  part  to  the  deaise  of  the 
Soviet  Union  and  the  Warsaw  Pact,  as  well  as  budget  realities  associated  with 
the  United  States  looking  inward  to  solve  its  donestlc  problens.  To 
Illustrate  the  point,  in  1990  the  Departnent  of  Defense  budget  was  9299.3 
billion  (3:349).  In  fiscal  year  1994  it  stands  at  9241  billion  (15:8),  a  19 
percent  reduction  over  1990.  Further,  in  1985,  the  Air  Force  operated  with 
38.5  fighter  wing  equivalents.  By  1996,  that  nunber  will  be  cut  nearly  in 
half,  down  to  20  fighter  wing  equivalents. 


MLthln  the  Air  Force  Mlntenance  coMMinlty,  the  aethod  by  which 
■alntenence  le  accoapliehed  la  alao  chansing.  Flightline  techniciana  are  now 
working  aa  an  integral  part  of  an  operationa  aquadron  and  not  a  aaintenance 
aquadron.  In  addition,  the  Air  Force  is  aovlng  towards  a  two-level 
aaintenance  concept.  Under  this  concept,  a  aajority  of  the  Interaedlate  level 
repair  of  assets  (rebuilding  black  boxes  and  engines)  will  no  longer  be 
accoapllshed  at  base  level,  but  will  instead  be  done  at  a  depot. 

Finally,  the  realities  of  today's  environaent  have  caused  the  Air  Force 
to  reconsider  its  basing  concept.  Ho  longer  is  aaintalning  a  forward  presence 
econoalcally  or  strategically  sound.  Rather,  today's  focus  is  on  bringing 
forces  back  to  the  United  States,  and  projecting  power  froa  there  when  needed. 
This  new  strategy  is  encapsulated  within  the  foundation  of  "Global  Reach, 
Global  Power."  It  is  within  this  environaent  that  changes  aust  be  aade  to 
the  HOC  process. 

In  the  era  of  today's  allitary  budget  reductions,  the  first  question  that 
aust  be  asked  about  MDC  is,  "is  this  process  still  necessary,  and  if  ao,  are 
there  alternative  aethods  to  satisfy  the  requireaents  of  the  process 
custoaers?"  Answering  this  question  requires  the  custoaers  to  first  validate 
their  proceas  output  requireaents.  This  is  especially  laportant  in  an 
environaent  such  as  the  Air  Force  where  the  custoaer  aay  not  clearly  see  the 


cost  of  the  proceee.  An  envlronaent  where  additional  deaanda  on  the  proceaa 
•ay  not  directly  lead  to  additional  coata  to  the  cuatoaer  in  teraa  of  tiae  or 
•oney,  but  aay  carry  aignif leant  additional  coata  for  the  aystea  auppllera. 
Once  accoapliahing  thia  validation,  aanagera  of  the  NDC  process  should  analjrae 
whether  alternative  aethoda  for  aeetlng  cuatoaera’  needs  are  available.  For 
exaaple,  will  supply  usage  data  coablned  with  failure  rates  generated  froa 
aodeling  provide  the  sane  Inforaation  as  NDC?  If  so,  can  it  be  accoaplished 
aore  efficiently  and  acre  effectively  than  NDC?  If  the  answer  to  all  of  these 
questions  la  yes,  then  this  aay  be  an  alternative  to  the  present  proceaa. 

If  however,  aanagera  of  the  NDC  proceaa  find  no  alternative  way  to  aeet 
the  needs  of  the  cuatoaer,  the  new  question  becoaea,  "How  do  we  laprove 
NDC?"  A  review  of  the  probleas  associated  with  the  NDC  proceaa  suggest  that 
by  concentrating  on  laproving  the  Input,  aany  of  the  reaainlng  probleas  would 
be  eliainated.  Key  aaong  these  is  laproving  the  quality  of  training 
•alntenance  technicians  receive  on  using  the  NDC  aystea. 

Vlhen  CAMS  was  originally  fielded,  aaintenance  technicians  were  given  a 
short  Introductory  class  on  CAMS  taught  by  a  aobile  training  teas  froa  Air 
Training  Coaaand.  This  training  was  generic  in  that  it  siaply  taught  basic 
skills  needed  to  use  CAMS,  and  did  not  address  applying  skllla  to  specific 
functional  specialties  (i.e.,  crew  chiefs,  back  shop  avionics,  phase  docks). 


•  •  • 


It 


m*  training  nan  then  aupplenented  with  over-the-ahoulder  training  by 


■alntenance  technlciana  from  other  baaea  who  were  already  ualng  CANS. 
Unfortunately,  the  over-the-ahoulder  training  waa  aporadlc,  and  taught  by 
individuala  with  only  a  narglnally  better  underatandlng  of  CANS  then  the 
atudent.  Finally,  there  waa  no  additional  training  provided  aa  new 
enhancenenta  to  CANS  were  fielded. 

Today,  CANS  training  ia  provided  to  all  new  airaen  going  through  initial 
aircraft  naintenance  technical  training.  Thia  training  providea  each  airman 
with  the  baalc  akllla  neceaaary  to  input  data  into  the  ayaten.  Further,  CANS 
refreaher  couraea  are  available  at  baaea  that  have  a  Field  Training  Detachaent 
(FTD).  Unfortunately,  due  to  the  attltudea  developed  during  initial  training 
on  CANS,  maintenance  aanagera  are  not  inclined  to  take  advantage  of  tbla 
available  training.  In  addition,  becauae  of  their  limited  akllla  with  the 
ayatea,  they  are  unable  to  anawer  queationa  of  newly  aaalgned  airaen  or 
provide  thea  with  additional  over-the-ahoulder  training. 

What  then  ia  the  aolution  to  the  NDC  training  laaue?  Initial  training 
during  technical  training  ia  a  good  flrat  atart.  However,  thia  needa  to  be 
auppleaented  with  a  aore  coaprehenalve  training  regime  once  the  individual 
arrlvea  at  their  firat  aaaignaent.  Thia  could  be  accoapliahed  by 
incorporating  CANS  uaage  into  the  maintenance  career  field  Career  Development 
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CourM  (CDC)  leMona  «nd  tests.  Further,  CAMS  proficiency  could  becose  s 
forasl  tssk  to  be  deaonstrsted  during  on-the-job  (OJT)  trsining.  This  twuld 
help  insure  s  trsiner  provided  the  tr since  with  st  lesst  s  sininus  level  of 
CAMS  trsining.  Finslly,  under  the  new  Air  Iducstion  end  Trsining  Cosasnd 
concept  of  sid-csreer  forssl  trsining,  nsintensnce  technicisns  could  receive 
CAMS  refresher  trsining,  snd  inforsstion  on  MDC  system  upgrsdes,  iriiile  back  in 
the  classroos. 

The  next  issue  to  address  is,  '*How  do  we  insure  the  trainer  ia 
knowledgeable  enough  to  provide  training  to  the  trainee?**  On  possible 
solution  is  to  put  an  MDC  expert  in  each  naintenance  organization  to  provide 
refresher  training.  The  logical  person  to  fill  this  position  would  be  a 
aesber  of  the  Air  Force  Engineering  and  Technical  Service,  or  AFETS.  An  AFETS 
is  an  Air  Force  civil  servant  iriio  has  been  hired  to  provide  technical 
expertise  in  a  specific  field  to  a  base's  saintenance  coasunity.  Typical 
AFETS  at  a  base  are  systea  experts  in  aircraft  fire  control  systems,  flight 
controls,  or  engines.  This  program  could  be  expanded  to  include  a  MDC  expert 
for  each  unit. 

The  AFETS  could  also  provide  the  solution  for  training  personnel  on 
upgrades  to  CAMS  and  other  MDC  systeas.  For  example,  when  an  iaproveaent  to 


CAMS  is  fielded  todsy,  there  is  no  formal  method  for  introducing  or  training 


field  personnel  on  the  upgrade.  In  the  future,  the  AFITS  could  serve  as  the 
forsal  training  source  for  insuring  personnel  were  trained  on  the  systen 
inprovenents .  By  serving  as  the  MDC  expert,  the  AFETS  could  also  provide 
valuable  feedback  to  those  developing  the  CAMS  software  on  problens  being 
experienced  in  the  field,  and  what  additional  systen  inprovenents  were  needed. 
Training  alone  however,  will  not  inprove  the  quality  of  input  into  the  MDC 
systen.  Just  as  Inportant,  is  inproving  the  "user-friendliness"  of  the 
systen. 

One  of  the  slnplest  ways  to  Inprove  the  quality  of  Infornation  coning  out 
of  a  data  collection  systen,  is  to  nake  inputting  data  into  the  systen  easier. 
This  can  be  acconplisbed  two  ways;  by  providing  clearer  guidance  on  how  to 
input  data,  and  by  sinplifying  actual  data  input.  Efforts  are  already 
underway  to  inprove  the  guidance  on  Inputting  data  into  CAMS.  First,  user 
nanuals  are  being  rewritten,  this  tine  with  the  nalntenance  technician  in 
nlnd.  This  neans  that  systen  use  is  described  in  clear  terns  that  everyone 
can  understand,  not  just  those  who  are  highly  proficient  with  autonated  data 
collection  systens.  Second,  "help"  screens  are  being  added  to  the  systen 
for  describing  the  nost  connon  of  data  input  requirenents .  Although  helpful 
in  reducing  user  frustration  for  the  technician,  these  two  steps  represent 
only  a  fraction  of  what  can  be  done  to  inprove  the  ease  of  inputting  data. 


Real  laproveaenta  In  slapllfylng  data  Input  can  be  gained  by  utilizing 
exiating  coaputer  technologlea.  For  exaaple,  touch  screens  coxbined  with 
Icons  would  provide  a  auch  "friendlier"  appearance  to  the  technician  than 
the  present  naze  of  data  screens.  As  a  result,  technicians  aay  feel  less 
threatened  by  the  systen,  and  nore  likely  to  input  data. 

Another  technology  that  could  slapllfy  data  collection  would  be  the 
introduction  of  bar  code  technology  into  the  data  collection  process.  Hand¬ 
held  bar  code  readers  such  as  those  eaployed  by  overnight  delivery  services 
could  sake  inputting  data  significantly  easier  than  the  present  nethod  of 
writing  the  infornation  down  and  carrying  it  to  the  nearest  input  terminal. 

The  added  benefit  of  the  aobile  bar-code  reader  is  that  it  puts  the  input 
terainal  at  the  Job  site,  ellainating  the  prlaary  cause  of  inaccurate  output 
data — incosplete  input  data  due  to  voluntary  non-collection  by  the  technician. 

This  technology  could  be  coxbined  with  another  presently  available 
technology,  xoblle  radio-frequency  (RF)  computer  terminals,  to  further 
increase  the  likelihood  of  data  input.  Although  RF  terminals  have  been 
successfully  tested  with  CAMS,  the  Air  Force  has  not  centrally  funded  then, 
and,  as  a  result,  they  have  not  been  widely  fielded.  By  utilizing  the  RF 
terminals,  not  only  would  the  likelihood  of  data  collection  improve,  but 
information  availability  would  improve  as  well.  For  example,  senior 
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fllthtllne  unagers  would  now  have  direct  acceaa  to  query  the  supply  syatea 
for  the  availability  of  parts  from  their  trucks,  rather  than  having  to  drive 
off  the  flightline  to  an  available  telephone.  Each  of  these  technologies 
would  increase  the  likelihood  that  not  only  would  acre  data  aake  it  into  the 
systea,  but  the  data  would  be  aore  accurate  than  that  presently  being  entered. 
This,  coabined  with  laproveaents  with  training  and  guidance,  should 
draaatically  laprove  the  process  of  inputting  data. 

With  laproveaents  to  the  input  process  identified,  the  next  step  is  to 
identify  laproveaents  that  can  be  aade  to  the  input  data  itself.  As  was 
previously  aentioned,  data  eleaents  being  collected  in  the  MDC  process  have 
not  been  updated  since  1958.  This  is  not  to  laply  however,  that  there  have 
not  been  laproveaents  aade  in  the  quality  of  inforaation  generated  concerning 
aircraft  aaintenance  discrepancies.  For  exaaple,  in  the  early  1980s,  the  Air 
Force  transitioned  to  a  aore  effective  systea  of  tying  aircraft  systea 
failures  to  corrective  actions — the  MIDAS  nuabering  systea — for  its  technical 
orders.  MIDAS  was  lapleaented  on  the  F-15  and  the  F~16^  and  has  been 
Incorporated  into  the  troubleshooting  guides  of  every  new  Air  Force  aircraft 
since  then.  Despite  that  fact,  MDC  continues  to  use  the  data  eleaents 
originally  established  in  1958.  Converting  to  the  MIDAS  nuabering  systea 
however,  will  benefit  both  the  data  supplier — the  aaintenance  technician — and 
the  custoaers  of  the  MDC  process. 
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Today  for  exaaple,  the  aalntenance  technician  receives  a  pilot  reported 


discrepancy  described  in  both  narrative  fora  and  in  a  MIDAS  Fault  Reporting 
Code  that  coaes  froa  a  technical  order  Fault  Reporting  Manual.  Utilizing  the 
fault  reporting  code,  the  aaintenance  technician  consults  a  technical  order 
Fault  Isolation  Manual  that  provides  the  logic  to  accurately  isolate  the 
aircraft  systea  failure  to  a  specific  problea.  This  failure  is  represented  in 
the  aanual  by  a  unique  MIDAS  Reference  Designator.  The  reference  designator 
also  Identifies  a  specific  technical  order  job  guide  that  describes  the  repair 
process  in  detail.  A  key  benefit  of  MIDAS  is  that  the  data  collected  during 
this  process  was  generated  as  part  of  the  repair  process,  not  in  addition  to 
it.  as  is  the  case  with  the  data  eleaents  presently  being  collected  in  MDC. 
Further,  the  MIDAS  data  eleaents,  if  used  in  MDC,  would  tie  a  very  specific 
description  of  a  systea  failure  to  the  exact  cause  of  the  problea,  and  the 
specifics  of  what  it  took  to  fix  the  problea.  This  is  in  direct  contrast  to 
the  present  systea  which  describes  probleas  in  teras  such  as  ’’broke”,  and 
repair  actions  in  teras  such  as  "repaired.  ” 

The  aost  significant  benefit  of  transitioning  to  a  MIDAS  nuabering 
systea  however,  is  that  data  collection  and  aircraft  troubleshooting  would 


becoae  a  single  process.  As  previously  described,  each  step  of  the 


troubleshooting  process,  froa  identifying  a  pilot  reported  discrepancy  to 
generating  a  specific  description  of  the  repair  action,  can  be  represented  by 
a  MIDAS  code  that  reflects  both  a  specific  portion  of  an  aircraft  aaintenance 
technical  order  and  a  data  eleaent  in  the  MDC  process.  This  provides  the 
potential  for  using  MDC  to  not  only  collected  R&M  data,  but  to  iaprove 
aircraft  troubleshooting  technical  orders  as  well.  By  being  able  to  collect 
large  voluaes  of  data  tying  systea  failures  to  successful  repair  actions, 
those  writing  technical  orders  could  validate  the  accuracy  of  the 
troubleshooting  guides.  An  added  benefit  froa  this  process,  besides  the 
obvious  iaproveaents  to  troubleshooting  guides,  is  that  technicians  would  see 
a  tangible  benefit  froa  the  MDC  process,  perhaps  activating  thea  to  provide 
acre  coaplete  and  accurate  Inputs. 

The  final  step  in  this  laproveaent  process  is  to  incorporate  MDC, 
troubleshooting  guides,  and  troubleshooting  equipment  into  a  single  process. 
This  concept  is  now  being  tested  under  a  prograa  known  as  the  Integrated 
Maintenance  Inforaation  Systea  (IMIS).  Under  IMIS,  a  single  autoaated  systea 
would  analyze  the  aircraft  for  probleas  through  a  connection  with  the 
aircraft's  on-board  coaputers,  walk  the  technician  through  any  repair 
processes  needed,  and  collect  all  of  the  associated  inforaation  for  input  into 
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NDC.  This  process  tskes  the  concept  of  ■Inlslzlng  the  effort  required  to 
collect  qusllty  MDC  data  to  its  ultiaate  conclusion. 

The  final  elesent  In  laying  out  a  road  sap  for  laproving  the  MDC  process 
is  to  Insure  that  all  custoaers*  needs  are  being  aet,  In  particular  the  needs 
of  leaders  and  aanagers  working  In  the  deployed  envlronaent.  As  designed,  the 
MDC  systea  Is  centered  around  a  base’s  aaln  coaputer  systea.  VRien  a  unit  of 
aircraft  deploy  to  a  location  away  froa  hoae  station,  aalntenance  personnel 
still  have  access  to  their  hoae  station  through  the  Defense  Data  Ketwork 
(DDN).  Just  as  laportant,  hoae  station  senior  aalntenance  aanagers  have 
access  to  Inforaatlon  concerning  the  deployed  aircraft.  This  applies  even 
when  units  are  deployed  to  an  envlronaent  such  as  Saudi  Arabia  during  Desert 
Shield/Stora.  Unfortunately,  during  a  caapalgn  such  as  Desert  Shleld/Stora, 
the  decision  aakers  who  needed  access  to  Inforaatlon  about  the  deployed 
aircraft  were  not  those  at  hoae  station,  but  those  running  the  caapalgn  such 
as  aeabers  of  the  CENTAF  staff  In  this  exaaple.  As  was  previously  described, 
the  MDC  systea  as  It  presently  exists,  is  not  designed  to  aeet  their  needs. 

■Mere 

Nor  have  thets  been  any  requlreaents  established  to  develop  this  capability 
for  the  systea. 

One  alternative  to  solve  this  problea  aay  be  to  specifically  identify 
idtat  aalntenance  data  are  required  by  deployed  senior  aanagers^  and 


Incorporate  thoae  needs  into  soae  future  deployable  connand  and  control 


aystea,  fulfilling  the  information  requirements  for  all  specialties,  not  just 
maintenance.  Regardless  of  Mhat  the  solution  Is^ however,  with  the  environment 
transitioning  from  overseas  basing  to  that  of  CONUS  basing  and  reliance  on 
"Global  Reach,  Global  Power,"  the  likelihood  of  future  large  deployments, 
and  the  requisite  Information  systems  to  support  those  deployments,  is  only 
going  to  increase. 

VII.  Conclusions 

Since  General  Creech's  tenure  as  the  Commander  of  TAC,  the  aircraft 
maintenance  community  has  relied  on  process  measurement  as  one  of  the  tools  to 
Improve  the  quality  of  its  product — combat  capability.  Automated  MDC  systems 
have  helped  to  Improve  the  process.  However,  there  is  still  much  work  to  do. 

This  paper  provided  a  road  map  for  accomplishing  those  improvements. 
First,  the  Air  Force  must  decide  if  a  maintenance  data  collection  system  is 
still  necessary,  or  whether  there  are  alternatives  that  could  provide  the  same 
data.  If  the  conclusion  is  that  the  MDC  system  is  still  necessary,  then 
Improvements  must  be  made  to  each  of  the  five  elements  of  the  process, 
beginning  with  the  way  technicians  are  trained  on  MDC.  At  the  same  time, 
there  must  be  improvements  in  the  system’s  "user  friendliness,"  focusing  on 
clearer  system  aids,  as  well  as  incorporating  existing  computer  technologies 
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to  slapllfy  systea  use.  laproveaents  to  the  specific  data  being  collected  are 
also  essential  to  asking  MDC  a  viable  tool.  Systeas  such  as  MIDAS  provide  the 
possibility  of  collecting  auch  aore  accurate  data,  and  for  asking  MDC 
collection  a  by-product  of  repairing  aircraft,  not  a  process  in  Itself. 
Finally,  the  MDC  process  aust  evolve  with  the  realities  of  today's  Air  Force, 
a  CONUS  based  force,  and  do  a  auch  better  job  of  aeetlng  the  needs  of  one  of 
its  prlaary  custoaers,  the  deployed  coaaander  and  his  staff. 

The  recoaaendatlons  in  this  paper  will  not  coae  free.  More  useful  and 
tlaely  aalntenance  data  will  cost  the  Air  Force  aoney  at  a  tiae  when  budgets 
are  being  reduced.  But  the  cost  for  not  iaprovlng  the  systea  could  be  even 
higher.  As  the  Air  Force  continues  its  aove  towards  aalntenance  generalists, 
two-level  aalntenance,  and  unit  funding  for  spare  parts,  the  need  for  accurate 
aalntenance  data  has  never  been  greater.  The  need  for  change  is  apparent. 

All  that  reaains  is  the  resolve  to  do  so. 
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